Requirements Analysis Method For Extracting-Transformation-Loading (Etl) In Data Warehouse Systems

نویسندگان

  • Azman Taa
  • Mohd Syazwan Abdullah
  • Norita Md. Norwawi
چکیده

The data warehouse (DW) system design involves several tasks such as defining the DW schemas and the ETL processes specifications, and these have been extensively studied and practiced for many years. The problems in heterogeneous data integration are still far from being resolved due to the complexity of ETL processes and the fundamental problems of data conflicts in information sharing environments. The understanding of an early phase of DW development is essential in properly tackling the complexity of ETL processes. The method to analyses the DW requirements from the abstract level (e.g. goal, sub-goal, stakeholder, dependency) toward the specification of ETL processes (e.g. extracting, filtering, conversion) are important in order to manage the complexity of the ETL processes design (e.g. semantic heterogeneity problems). However, current approaches that are based on existing software requirement approach still have limitations on translating the business semantics for DW requirements toward the ETL processes specifications. Moreover, the understanding of goal in the perspective of the organization and decision makers are important to ensure the semantic of DW requirements can be properly determined, organized, and implemented by the ETL processes. Therefore, the proposed method will utilize the ontology with goal-driven approach in analyzing the requirements of ETL processes.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Management of Conformed ETL Architecture

This paper deals with the core research on the architecture of ETL process which is applied on BI environment along with the advent of metadata at each corresponding layer that can be applicable to all the scenarios of BI. The management of extraction process has been done using several operators which help in reducing its complexity. New operators have been developed to easily understand each ...

متن کامل

Query Optimizer for the ETL Process in Data Warehouses

ETL (Extraction-Transformation-Loading) process is responsible for extracting data from several sources, cleansing, transforming, integrating and loading into a data warehouse. Extraction process accesses large amount of data by executing several complex queries in source databases. These queries are repetitive and executed at regular interval to refresh the data warehouse. Extraction of data f...

متن کامل

XML based Framework for ETL Processes For Relational Databases

In Data Warehousing, Extraction-Transformation-Loading (ETL) are the key tasks that are responsible for the extraction of data from several sources, their cleansing, customization and insertion into data warehouse [10]. More specifically ETL tools are category of specialized tools with the task of dealing with data warehouse cleaning and loading problems. These task are very critical in every d...

متن کامل

ETL Extract , Transform and Load ( ETL ) Performance Improved by Query Cache

Extraction, Transformation, and Loading (ETL) processes are responsible for the operations taking place in the back stage of a data warehouse architecture Extract, transform and load (ETL) is the core process of data integration and is typically associated with data warehousing. ETL tools extract data from a chosen source, transform it into new formats according to business rules, and then load...

متن کامل

بهبود فرآیند استخراج، تبدیل و بارگذاری در پایگاه داده تحلیلی با کمک پردازش موازی

Abstract Data Warehouses are used to store data in a structure that facilitates data analysis. The process of Extracting, Transforming, and Loading (ETL) covers the process of retrieving required data from the source system and loading them to the data warehouse. Although the structure of source data (e.g. ER model) and DW (e.g. star schema) are usually specified, there is a clear lack of a ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009